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EXECUTIVE  SUMMARY 


This  document  presents  the  Terminal  Doppler  Weather  Radar  (TDWR)  Build 
5B  Operational  Test  and  Evaluation  (OT&E)  Operational  and  OT&E 
Integration  Test  Plan.  This  test  plan  is  written  in  accordance  with 
FAA-STD-024a  and  FAA  Order  1810.4B,  and  provides  the  overall 
philosophy  and  approach  to  TDWR  Build  5B  OT&E  testing.  Plus,  this 
test  plan  identifies  OT&E  objectives,  responsibilities,  and  resources. 

TDWR  Build  5B  further  enhances  Build  5A  by  adding  an  interface  to  the 
Low  Level  Wind  Shear  Alert  System  Phase  III  (LLWAS  III)  to  display 
LLWAS  II  and/or  LLWAS  III  wind  products  along  with  TDWR  hazardous 
weather  data  on  TDWR  Geographical  Situation  Displays  (GSD)  and  Ribbon 
Display  Terminals  (RDT).  Other  Build  5B  enhancements  include; 

1.  TDWR/LLWAS  III  Integration  Algorithm, 

2.  Microburst  Shear  Integration  Algorithm  (MSIA) , 

3.  15-day  archiving  and  archive  data  playback, 

4.  Microburst  Detection  Algorithm  (MDA)  parameter  changes, 

5.  Programmable  alarm  timeouts, 

6.  Enhanced  Base  Data  Display  (BDD)  capabilities,  and 

7.  Upgraded  operating  systems  (OS)  for  the  Harris  (Harris  OS 
6.1)  and  SUN  work  stations  (SunOS  4.1. Sul). 

TDWR  Build  5B  OT&E  is  scheduled  to  occur  at  the  TDWR  site  in  Denver, 
CO,  from  August  to  September  1994.  Additional  OT&E  will  be  conducted 
in  Orlando,  FL,  during  spring  1995  to  thoroughly  evaluate  the 
effectiveness  of  the  MDA  parameter  changes,  MSIA,  and  TDWR/LLWAS  III 
Integration  Algorithm.  After  successful  completion  of  Build  5B  OT&E, 
the  Build  5B  enhancements  will  be  installed  at  an  LLWAS  II  site  to 
verify  that  Build  5A  functionality  has  not  been  degraded. 
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1. 


INTRODUCTION. 


The  Terminal  Doppler  Weather  Radar  (TDWR)  is  one  project  of  the 
National  Airspace  System  (NAS)  Plan,  whose  overall  goal  is  the 
modernization  and  improvement  of  the  government  systems  supporting 
aviation  commerce  in  the  United  States.  In  the  end- state  of  the  NAS 
Plan,  the  TDWR  will  send  weather  product  information  to  air  traffic 
control  (ATC)  computers  at  the  Tower  Control  Computer  Complex  (TCCC) . 
Also,  in  the  end- state,  a  mechanism  will  be  provided  to  transmit  TDWR 
hazardous  weather  information  directly  to  pilots.  The  end-users  of 
TDWR  outputs  are  local,  approach,  and  departure  controllers,  their 
supervisors,  and  pilots.  In  the  interim  NAS,  the  TDWR  product 
information  will  be  displayed  to  air  traffic  specialists;  i.e., 
controllers-  and  controllers'  supervisors. 

The  Build  5  enhancement  is  intended  to  enable  the  TDWR  to  further  meet 
the  goals  of  the  NAS  Plan.  This  will  be  accomplished  by  interfacing 
the  TDWR  to  the  Low  Level  wind  Shear  Alert  System  (LLWAS)  and  by 
improving  existing  TDWR  functionality. 

The  Build  5  enhancement  for  the  TDWR  is  being  implemented  in  two 
stages:  Build  5A  and  Build  5B.  Build  5B  includes  all  Build  5A 
enhancements  plus  several  other  enhancements,  identified  in  section 
1.1.  This  test  plan  addresses  only  that  functionality  included  in 
Build  5B.  In  addition,  this  test  plan  has  been  tailored  to  address 
only  those  Operational  Test  and  Evaluation  (OT&E)  Integration,  OT&E 
Operational,  and  NAS -SS- 1000  requirements  not  previously  verified 
during  baseline  and  Build  5A  OT&E.  However,  some  of  the 
aforementioned  requirements  will  be  reverified  to  ensure  baseline 
performance  has  not  been  degraded  by  the  Build  5B  enhancements. 

OT&E  Integration  and  OT&E  Operational  testing  has  been  completed  on 
the  baseline  TDWR  system,  as  well  as  the  Build  5A  enhancement.  All 
NAS -SS- 1000  requirements  successfully  verified  during  previous  OT&E 
will  be  identified  as  such  in  the  Test  Verification  Requirements 
Traceability  Matrix  (TVRTM)  included  in  appendix  A.  Some  of  these 
requirements  will  be  verified  again  to  ensure  that  the  baseline  system 
performance  has  not  been  degraded. 

1 . 1  BACKGROUND . 

Build  5B  will  provide  an  interface  to  the  LLWAS  Phase  II  (LLWAS  II) 
and  Phase  III  (LLWAS  III) .  LLWAS  II  consists  of  six  sensors  and  a 
computer  system  to  process  wind  information.  LLWAS  III  consists  of  up 
to  29  sensors  and  a  computer  system  to  process  wind  information. 

Build  5B  will  accept  LLWAS  II  or  LLWAS  III  Center  Field  Wind  (CFW)  and 
runway  threshold  winds  and  display  them  on  the  TDWR  Display  Functional 
Unit  (DFU)  which  is  composed  of  a  Geographical  Situation  Display  (GSD) 
and  up  to  eight  Ribbon  Display  Terminals  (RDT) .  Other  Build  5B 
functionalities  include: 

a.  TDWR/LLWAS  III  Integration  Algorithm; 
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b.  Microburst  Shear  Integration  Algorithm  (MSIA) ; 

c.  15 -Day  archiving  and  archive  data  playback; 

d.  Microburst  Detection  Algorithm  (MDA)  parameter  changes; 

1 .  Minimum  divergence  segments  of  4 , 

2.  Minimum  alarm  segments  of  5, 

3.  Minimum  alarm  delta  v  of  10  m/s, 

4.  Minimum  storm  top  altitude  of  1.5  km, 

5.  Minimum  storm  cell  area  of  2  mi^, 

6.  Storm  overlap  test  (dry  cell), 

7.  Storm  centroid  distance  of  3  km; 

e.  Programmable  alarm  timeouts; 

f.  Enhanced  Base  Data  Display  (BDD)  capabilities; 

g.  Upgraded  operating  systems  (OS)  for  the  Harris  {Harris  OS 
6.1)  and  SUN  work  stations  (SunOS  4.1.3ul). 

1.2  TEST  PHILOSOPHY. 

The  Federal  Aviation  Administration  (FAA)  conducts  OT&E  in  accordance 
with  FAA  Order  1810. 4B  to  evaluate  the  subsystem  operational 
effectiveness  and  suitability  including  compatibility, 
interoperability,  degraded  operations,  survivability,  maintainability, 
and  supportability .  OT&E  also  identifies  deficiencies  in  NAS 
hardware,  software,  human  performance  factors,  and/or  operational 
concepts.  OT&E  consists  of  three  phases:  Integration,  Operational, 
and  Shakedown.  Only  OT&E  Integration  and  OT&E  Operational  phases  will 
be  addressed  in  this  test  plan.  OT&E  Shakedown  activities  will  be 
addressed  in  the  AOS-230  TDWR  Build  5B  OT&E  Shakedown  Test  Plan. 
Division  of  responsibilities  for  FAA  OT&E  Integration  and  OT&E 
Operational  testing  are  illustrated  in  figure  1.2-1.  Since  Build  5B 
is  an  enhancement  to  the  TDWR  baseline  system,  only  those  blocks  not 
shadowed  will  be  evaluated. 

1.2.1  OT&E  Integration. 

OT&E  Integration  consists  of  testing  NAS  System  End-to-End 
performance,  specifically,  NAS-SS-1000,  volume  I  system  level  and 
volumes  II  through  V  subsystem  level  requirements  as  identified  in  the 
TDWR  Test  and  Evaluation  Master  Plan  (TEMP)  Verification  Requirements 
Traceability  Matrix  (VRTM) .  This  testing  establishes  NAS  baseline 
performance  (end-to-end)  or  verifies  that  previously  existing  NAS 
performance  has  not  been  degraded.  To  the  greatest  extent  possible 
the  subsystem  will  test  in  a  NAS  system  equivalent  environment. 
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OT&E  Integration  will  be  conducted  at  the  Denver,  CO,  TDWR  site  (DVX) 
will  address  and  evaluate  the  readiness  of  the  system  for  integration 
and  transition  into  the  field.  In  addition,  this  activity  will 
evaluate  the  system  performance  in  critical  test  areas,  test  the 
limits  of  system  performance,  and  provide  operational  performance 
benchmarks . 

The  OT&E  Integration  effort  is  conducted  with  the  following 
objectives: 

a.  Verify  the  TDWR's  capability  to  properly  interface  and 
function  with  the  associated  NAS  subsystems,  including 
hardware,  software,  operational,  and  maintenance  activities; 

b.  Ensure  the  detection  of  interface  design  problems; 

c.  Minimize  site  problems  by  comprehensive  integration  testing 
and  evaluation; 

d.  Verify  the  requirements  of  the  NAS  System  Specification. 
1.2.2  OT&E  Operational  Testing. 

OT&E  Operational  testing  is  to  verify  the  operational  effectiveness 
and  suitability  of  the  equipment  with  user's  participation.  Aspects 
of  this  testing  are  as  follows: 

a.  Reliability  and  availability; 

b.  Degraded  operations  and  operational  utilization  scenarios; 

c.  Stress  and  NAS  loading  testing  of  all  interoperable 
subsystems ; 

d.  Human  factors; 

e.  Site-adaptation; 

f.  Weather  Detection  Performance. 

OT&E  Operational  testing  employs  system  users  to  assess  operational 
suitability  and  effectiveness  of  the  subsystem  in  the  NAS  environment. 
Testing  will  be  conducted  at  DVX  in  accordance  with  established  OT&E 
requirements.  This  testing  will  evaluate  system  functions,  data  entry 
and  display  devices.  Human  Engineering,  Computer-Human  Interface, 
training,  training  documentation  for  ATC  operations,  systems 
maintenance,  and  support  operations.  Test  will  be  structured  in  a 
building  block  fashion  starting  with  an  evaluation  of  basic  functions 
and  operations,  and  progressing  to  evaluations  during  complex 
integrated  operations . 
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The  OT&E  Operational  test  objectives  are: 

a.  Verification  and  validation  of  the  operational  requirements; 

b.  Evaluation  and  determination  of  the  effect  of  the  segment 
under  test  on  the  operational  mission; 

c.  Identification  and  evaluation  of  the  safety  factors  involved 
during  transition  and  determination  that  transition  can  be 
achieved  safely; 

d.  Evaluation  of  the  subsystem's  operations  and  maintenance 
with  respect  to  the  variations  in  site  configuration  and 
adaptation; 

e.  Assessment  of  the  subsystem's  capability  to  support  current 
and  future  modifications. 


1.2. 2.1  Reliability  and  Availabilit'^ 


OT&E  will  be  conducted  to  verify  that  Build  5B  does  not  degrade 
diagnostics  accuracy.  Mean  Time  Between  Failure  (MTBF),  and  Mean  Time 
Between  Critical  Failure  (MTBCF) . 


1 . 2 . 2 . 2  Degraded  Operations . 


This  test  is  conducted  to  determine  the  acceptability  of  the  resultant 
operational  degradation  when  failures  are  induced  in  the  system.  This 
includes  validation  of  shutdown  procedures,  startup  procedures, 
degraded  operations  procedures,  and  operational  impact  of  the  data 
preservation  function  upon  recovery. 


1.2. 2. 3  Stress  and  NAS  Loadinc 


This  test  estimates  the  levels  of  stress  and  NAS  loading  provided  by 
the  operational  environment. 


1.2. 2. 4  Human  Factors. 


This  test  estimates  the  degree  of  accommodation  to  which  the 
interaction  of  personnel  with  the  system  in  the  operational 
environment  is  needed.  Test  and  evaluation  (T&E)  should  explore  such 
factors  as  the  physical  interaction  of  personnel  with  a  system, 
interactions  with  procedures,  workloads,  and  operational  environments. 


1.2. 2. 5  Site  Adaptation. 


This  test  ensures  that  site  data  unique  to  each  applicable  NAS 
facility  has  been  correctly  developed,  updated,  and  installed  in  the 
system. 
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1.3  PURPOSE  OF  TEST  PLAN. 


The  purpose  of  this  plan  is  to  ensure  that  comprehensive  OT&E 
Integration  and  OT&E  Operational  testing  is  conducted.  This  plan 
describes  the  test  program,  identifies  organizational 
responsibilities,  and  provides  a  basis  for  the  development  of  OT&E 
Integration  and  OT&E  Operational  test  procedures. 

1.4  SCOPE  OF  TEST  PLAN. 

This  plan  provides  for  comprehensive  testing  of  the  Build  5B 
enhancement  to  the  current  TDWR  system  to  ensure  it  satisfies  user  and 
NAS  requirements.  It  describes  the  OT&E  Integration  and  OT&E 
Operational  test  processes  for  ensuring  this  enhancement  meets 
applicable  subsystem/system  requirements  allocated  in  NAS -SS- 1000, 
volumes  I,  III,  and  V. 


1.5  DOCUMENT  OVERVIEW/ORGANIZATION. 


This  paragraph  describes  each  section  of  the  test  plan. 

Section  1;  Introduction.  This  section  provides  an  introduction  to 

the  TDWR  Build  5B  OT&E  Integration  and  OT&E  Operational 
Test  Plan.  In  addition,  it  provides  the  purpose  and 
scope  of  the  test  plan. 

Section  2;  Documents.  All  documents  directly  referenced  in  the 
plan  and  all  other  documents  related  to  this  plan  are 
listed  in  this  section. 


Section  3: 


Section  4: 


Section  5; 


Section  6 : 


System  Description.  This  section  provides  a  brief 
system  overview  including  a  block  diagram.  It  also 
identifies  the  current  and  future  interfaces. 

Test  Program  Description.  This  section  describes  the 
OT&E  approach  and  concept,  test  environment,  and  test 
descriptions . 

Test  Management.  This  section  defines  the  roles  and 
responsibilities,  training,  test  conduct,  test  reports, 
schedules,  and  personnel  resource  requirements. 

Acronyms  and  Abbreviations.  All  acronyms  and 
abbreviations  used  throughout  this  document  will  be 
listed  in  this  section. 


Appendix  A:  This  appendix  is  a  detailed  TVRTM. 

Appendix  B:  A  detailed  Build  5B  Test  Schedule  is  presented  in  this 

appendix. 
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2 .  DOCUMENTS . 


This  section  lists  the  documentation  and  reference  materials  which 
relate  to  the  contents  of  this  plan. 

2 . 1  REFERENCED  DOCUMENTS . 


FAA-E-2806/1 


NAS-SS-1000 


NAS-SS-1000 


NAS-SS-1000 


TDWR  Specification,  November  12,  1992,  with 
Specification  Change  Notice  (SCN)  1,  January  2, 
1993. 

NAS  System  Specification,  Volume  I,  Functional  and 
Performance  Requirements  for  the  National  Airspace 
System  General,  October  1992. 

NAS  System  Specification,  Volume  III,  Functional 
and  Performance  Requirements  for  the  Ground- to-Air 
Element,  February  1993. 

NAS  System  Specification,  Volume  V,  Functional  and 
Performance  Requirements  for  the  National  Airspace 
System  Maintenance  and  Operations  Support  Element, 
October  1992. 


NAS  - IR- 31023105  LLWAS  Phase  II  to  TDWR  Interface  Requirements 
Part  2,  Rev.  A  Document  (IRD) . 

NAS -IR- 31023105  LLWAS  Phase  III  to  TDWR  IRD,  December  7,  1993 
Part  1,  Rev.  C 


NAS-IC-31055103-00  TDWR  Remote  Monitoring  Subsystem  (RMS) /Maintenance 

Processor  Siibsystem  (MPS)  Interface  Control 
Document  (ICD) . 

NAS-IC-31055104 -00  TDWR/Maintenance  Data  Terminal  (MDT)  ICD. 


NAS -IC- 31052201 -00  TDWR/Tower  Control  Computer  Complex  (TCCC)  ICD. 

FAA- STD -024a  Preparation  of  Test  and  Evaluation  Documentation, 

August  17,  1987. 


No.  1810. 4B 


FAA  NAS  Test  and  Evaluation  Policy,  October  22, 
1992. 


2.2  BACKGROUND  DOCUMENTS. 


TDWR  TEMP  TDWR  Build  5  Enhancement  Test  and  Evaluation 

Master  Plan  (TEMP),  November  1993. 

NAS -MD- 110  Test  and  Evaluation  (T&E)  Terms  and  Definitions 

for  the  NAS,  March  27,  1987. 


7 


NAS -MD- 790 

NAS -MD- 79 3 

D001-Bld5-2 

B022-Bld5-1A 

B022-Bld5-2B 

B022-Bld5-3B 


Remote  Maintenance  Monitoring  System  Interface 
Control  Document  Maintenance  Processor  Subsystem 
to  Remote  Monitoring  Subsystem  Concentrators,  June 
10,  1986. 

Remote  Maintenance  Monitoring  System  Functional 
Requirements  for  the  Remote  Monitoring  Subsystem 
(RMS),  June  10,  1986. 

TDWR  Contractor's  Master  Test  Plan  (CMTP)  Build  5 
Addendum,  January  12,  1993. 

Build  5  Software  Requirements  Specification  Radar 
Product  Generation  (RPG)  Software,  CSCI-2 
CGG551591,  Revision  A,  November  19,  1992. 

Build  5  Software  Requirements  Specification  RMS 
Software,  CSCI-3  CGG551592,  Revision  B,  June  30, 
1993. 

Build  5  Software  Requirements  Specification 
Display  Computer  (DPL)  Software,  CSCI-4  CGG551594, 
Revision  B,  June  24,  1993. 
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3.  SYSTEM  DESCRIPTION. 


The  primary  goal  of  the  TDWR  is  to  enhance  the  safety  of  air  travel 
through  the  timely  detection  and  reporting  of  hazardous  wind  shear  in 
and  near  the  terminal  approach  and  departure  zones  of  an  airport. 
Specific  sources  of  hazardous  wind  shear  to  be  detected  are 
microbursts  and  gust  fronts.  The  secondary  goal  of  the  TDWR  is  to 
improve  the  management  of  air  traffic  in  the  terminal  area  through  the 
forecast  of  gust  front  induced  wind  shifts  at  the  airport,  as  well  as 
detection  of  precipitation. 

3.1  SYSTEM  OVERVIEW. 

3.1.1  Equipment  Description. 

The  TDWR  can  be  functionally  divided  into  three  subsystems:  Radar 
Data  Acquisition  (RDA) ,  Radar  Product  Generation/Remote  Monitoring 
Subsystem  (RPG/RMS) ,  and  the  DFU. 

The  RDA  function  performs  the  radar  data  collection,  detection,  signal 
processing,  clutter  suppression,  control  monitoring,  and  error 
detection  subfunctions  for  the  TDWR  system.  The  RDA  consists  of  the 
Antenna  Group  (ANT)  which  includes  the  Radome,  Pedestal  Assembly, 

Tower  Assembly,  Reflector  Assembly,  Servo  Control  Unit  (SCU) ,  and 
Moving  Target  Simulator  (MTS) .  The  RDA  also  includes  the  microwave 
pallet  and  redundant  Transmitters  (XMT) ,  Receiver/Exciters  (REX) ,  and 
Digital  Signal  Processors  (DSP) . 

The  RPG/RMS  functions  process  moment/dwell  data  from  the  RDA,  exchange 
control  and  status  signals  with  the  RDA,  transmit  data  to  the  DFU,  and 
provide  the  interfaces  to  LLWAS  II/III,  RMMS/MDT,  and  TCCC. 

The  DFU  equipment  consists  of  a  GSD  for  viewing  weather  products,  and 
from  zero  to  eight  alphanumeric  RDT  for  viewing  alert  messages.  GSD 
capabilities  also  include  range  scale  selection,  recentering  of 
displayed  products,  selection  of  runway  configuration,  and  archiving 
of  weather  products. 

3.1.2  Equipment  Archi tecture . 

The  TDWR  system  is  configured  into  Hardware  Configuration  Items  (HWCI) 
and  Computer  Software  Configuration  Items  (CSCI) .  A  TDWR  HWCI  and 
CSCI  block  diagram  is  included  in  figure  3. 1.2-1. 
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Figure  3. 1.2-1  HWCI/CSCI  Diagram 
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Xe:  ROT  statua  is  used  by  LLWAS  III 
Ills  In  backup  mods  only. 


The  software  consists  of  operational  and  nonoperational  software. 
Operational  software  consists  of  operating  systems  (which  are 
Commercial-Off-the-shelf  (COTS)  products) ,  application  software 
Computer  Software  Configuration  Item(s)  (CSCI) ,  and  firmware  CSCIs. 
The  commercial  operating  systems  are  WTX-32  Operating  System  (CSCI-7) 
for  the  68020  single  board  computers,  the  Data  Processing  Operating 
System  (CSCI -10)  for  the  RPG/RMS,  and  the  Display  System  Operating 
System  (CSCI -11)  for  the  DFU.  Nonoperational  software  which  is  not 
part  of  TDWR  site  installations  consists  of  the  Software  Development 
Tools  (CSCI -5)  and  the  Test  Tools  Library  (CSCI -6) . 

The  HWCIs  consist  of  the  following: 

a.  Antenna  Group  (ANT)  HWCl-1 

b.  Transmitter  (XMT)  HWCI-2 

c.  Receiver -Exciter  (REX)  PlWCI-3 

d.  Digital  Signal  Processor  (DSP)  HWCI-4 

e.  Radar  Product  Generator/Remote  Monitoring  Subsystem 
(RPG/RMS)  HWCI-5 

f.  Display  Functional  Unit  (DFU)  HWCI-6 

g.  Special  Test  Equipment  (SPT)  HWCI-7 

h.  Program  Support  Facility  (PSF)  HWCl-8 

The  CSCIs  consist  of  the  following: 

A.  Operational  Software 

1.  Application  Software 

a.  Digital  Signal  Processor  (DSP)  CSCI-1 

b.  Radar  Product  Generator  (RPG)  CSCI -2 

c.  Remote  Monitoring  Subsystem  (RMS)  CSCI -3 

d.  Display  Computer  (DPL)  CSCI -4 

e.  Antenna  Control  (ANT)  CSCI-8  (Firmware) 

f.  Transmitter  Control  (XMT)  CSCI -9  (Firmware) 

2.  Operating  Systems 

a.  VRTX-32  Operating  System  (VTX)  CSCI-7 

b.  Data  Processing  Operating  System  (DPO)  CSCI -10 

c.  Display  System  Operating  System  (UNIX_UNX)  CSCI -11 

B.  Nonoperational  Software 

1.  Software  Development  Tools  (SDT)  CSCI-5 

2.  Test  Tools  Library  (TTL)  CSCI -6 
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3 . 2  INTERFACES . 


Build  5B  will  provide  external  interfaces  to  LLWAS  II /III,  Remote 
Maintenance  Monitoring  Subsystem  (RMMS) ,  Maintenance  Data  Terminal 
(MDT) ,  and  Tower  Computer  Control  Complex  (TCCC) .  These  interfaces 
are  shown  in  figure  3.2-1. 


FIGURE  3.2-1 .  TDWR  EXTERNAL  INTERFACES 
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3.2.1  LLWAS  II. 


The  TDWR  to  LLWAS  II  communications  interface  will  consist  of  a 
primary  and  backup  interface,  and  is  described  in  NAS-IR-31023105 , 

Part  2,  Revision  A.  The  primary  interface  will  connect  the  TDWR  RPG 
to  the  LLWAS  Tower  Display  port  on  the  LLWAS  processor.  The  backup 
interface  will  connect  the  TDWR  Tower  GSD  to  the  LLWAS  Spare  port  on 
the  LLWAS  processor.  In  the  event  of  a  primary  interface  failure,  the 
switch-over  from  primary  to  backup  will  occur  automatically.  Both 
interfaces  will  operate  at  1200  bits  per  second  (bps).  Figure  3. 2. 1-1 
presents  the  TDWR--LLWAS  II  interface.  Note:  TE  stands  for 
transmission  equipment. 


LLWAS  Faint  of 


FIGURE  3.2.1-1.  TDWR-LLWAS II  INTERFACE 
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3.2.2  LLWAS  III. 


The  TDWR  to  LLWAS  III  communications  interface  will  consist  of  a 
primary  and  backup  interface,  and  is  described  in  NAS-IR-31023105 , 

Part  1,  Revision  C.  The  primary  interface  will  connect  the  TDWR  RPG 
to  the  LLWAS  processor.  The  backup  interface  will  connect  the  TDWR 
Tower  GSD  to  the  LLWAS  processor.  In  the  event  of  a  TDWR  failure,  the 
switchover  from  primary  to  backup  will  occur  after  active  runways  are 
configured  using  the  LLWAS  keypad.  The  GSD  operator  will  then 
acknowledge  the  switchover  to  the  backup  link  via  a  GSD  menu 
indicating  that  TDWR  is  nonoperational .  Both  interfaces  will  operate 
at  9600  bps.  Figure  3. 2. 2-1  presents  the  TDWR--LLWAS  III  interface. 
Note:  TE  stands  for  transmission  equipment. 


LLWAS  Faint  of 


FIGURE  3.2.2-1 .  7DWR~U.WAS  III  INTERFACE 
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3.2.3  Remote  Maintenance  Monitoring  Subsystem  (RMMS) . 

The  TDWR  RPG/RMS  provides  the  following  interfaces : 

a.  RMMS:  The  RMMS  utilizes  the  Maintenance  Processor  Subsystem 
(MPS)  to  remotely  control  and  monitor  the  TDWR.  This 
interface  is  described  in  NAS-MD-790  and  NAS-MD-793. 

b.  MDT:  The  MDT  is  located  at  the  TDWR  site  in  the  Concrete 
Masonry  Unit  (CMU)  and  is  used  to  locally  control  and 
monitor  the  TDWR.  This  interface  can  operate  at  1200,  2400, 
4800,  and  9600  bps. 

These  interfaces  are  presented  in  figure  3. 2. 3-1.  Note:  TE  stands 
for  transmission  equipment. 


FIGURE  3.2.3-1 .  TDWR  -  MPS  AND  TDWR  -  MDT  INTERFACES 


3.2.4  Tower  Control  Computer  Complex  (TCCC) . 

The  TDWR  interfaces  to  TCCC  which  provides  for  transmission  of 
products,  equipment  status,  TDWR  modes,  and  receipt  of  commands.  When 
the  TCCC  becomes  available,  it  will  provide  data  to  appropriate  ATC 
facilities.  It  operates  at  9600  bps  and  is  described  in  NAS-IR- 
22013105,  Revision  E.  This  interface  is  presented  in  figure  3. 2. 4-1. 


ISWR  Point  of 
Demarcation 


FIGURE  3.2.4-1 .  TDWR  -  TCCC  INTERFACE 
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4.  TEST  PROGRAM  DESCRIPTION. 


4.1  APPROACH  AND  CONCEPT. 

In  order  to  detemine  the  operability  of  the  TDWR  Build  5B  enhancement 
with  the  NAS  environment ,  OT&E  Integration  and  OT&E  Operational 
testing  requires  that  the  TDWR  be  installed  in  an  operational 
environment  with  operational  support.  An  operational  environment 
refers  to  the  configuration  into  which  the  TDWR  must  be  integrated. 

For  this  reason,  both  live  and/or  simulated  interfacing  subsystems  and 
ec^ipment  will  be  used.  Air  Traffic  (AT)  and  Airways  Facilities  (AF) 
field  site  personnel  will  also  be  requested  to  participate  in  test 
efforts.  These  test  efforts  will  include  providing  support  in  writing 
and  executing  the  detailed  test  procedures  that  will  be  generated  by 
ACW-200  to  verify  the  requirements  identified  for  testing.  TDWR  OT&E 
Integration  and  OT&E  Operational  testing  will  be  performed  using  all 
interfaces  available  and  appropriate  to  the  TDWR  system. 

4.1.1  Operational  Issues/Test  Requirements  Summary. 

The  following  are  issues  related  to  the  Build  5B  enhancement: 

a.  LLWAS  III  wind  information  is  accurately  displayed  on  the 
GSDs  and  RDTs. 

b.  The  MDA  parameter  changes  increase  the  Probability  of 
Detection  (POD)  and  reduce  the  False  Alarm  Ratio  (FAR) . 

c.  The  MSIA  reduces  overwarnings  due  to  TDWR -genera ted 
microburst  alerts. 

d.  The  TDWR/LLWAS  III  Integration  Algorithm  generates  more 
accurate  Microburst  Alerts  (MBA)  and  Wind  Shear  Alerts  (WSA) 
than  either  stand-alone  system. 

e.  TDWR- -LLWAS  III  link  status  is  reported  accurately  to  the 
MPS  and  MDT. 

f.  The  performance  of  baseline  Build  5A  has  not  been  degraded 
using  Build  5B  enhancements. 

g.  Archiving,  programmable  alarm  timeouts,  and  enhanced  base 
data  display  capabilities  have  been  included  in  CSCI-4 
Software  Users'  Manual. 

All  NAS -SS- 1000  requirements  related  to  TDWR  have  been  included  in  the 
TVRTM  in  appendix  A.  The  specific  Build  5B  requirements  which  will  be 
tested  during  Build  5B  OT&E  are  identified.  Previously  verified  NAS 
requirements,  which  will  not  be  fully  tested  during  Build  5B  OT&E,  are 
also  identified. 
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4.1.2  Preliminary  Activities  Leading  to  Testing. 


Prior  to  OT&E  Integration  and  OT&E  Operational  testing,  ACW-200  shall 
prepare  the  Build  5B  OT&E  Integration  and  OT&E  Operational  test 
procedures.  In  addition,  the  Build  5B  enhancement  will  have 
successfully  undergone  extensive  Development  Test  and  Evaluation 
(DT&E) .  This  testing  is  conducted  by  the  prime  contractor  and 
witnessed  by  the  FAA.  Finally,  the  prime  contractor  will  install  the 
Build  5B  enhancement  and  successfully  complete  the  Build  5B  Interface 
Test  at  the  TDWR  site  in  Denver.  The  OT&E  Integration  and  OT&E 
Operational  test  flow  diagram  is  provided  in  figure  4. 1.2-1. 

4.1.3  Planning  Considerations  and  Limitations. 

Build  5B  OT&E  test  conduct  is  contingent  upon  the  completion  of  the 
LLWAS  III  to  TDWR  software  being  developed  by  LORAL.  In  addition,  the 
testing  of  the  TDWR--MPS  interface  described  in  paragraph  4. 3. 2.1  will 
be  contingent  upon  the  availability  of  the  appropriate  software. 

4 . 2  TEST  ENVIRONMENT . 

The  following  paragraphs  will  describe  the  test  facilities  where  the 
OT&E  testing  described  in  this  plan  will  be  conducted. 

4.2.1  Test  Location. 


The  Build  5B  enhancement  OT&E  Integration  and  OT&E  Operational  testing 
will  be  conducted  at  Denver.  Weather  data  will  be  collected  at  both 
Denver  and  Orlando  sites. 

4.2.2  Test  Configuration. 

The  DVX  TDWR  is  a  typical  site  installation  including  all  HWCIs 
(except  HWCI-8)  and  all  CSCIs  (except  CSCI-5  and  CSCI-6)  identified  in 
paragraph  3.1.2.  The  CSCIs  that  were  modified  for  Build  5B  include 
CSCIs -2,  3,  and  4.  The  only  hardware  addition  for  Build  5B  is  the 
portable  archive  data  recorder  (ADR)  which  connects  to  the  DFU, 

(HWCI-6) . 

The  TDWR  Special  Test  Equipment  (HWCI-7) ,  Base  Data  Recorder  (BDR)  and 
BDD,  will  be  utilized  to  record  and  playback  TDWR  base  data. 

4.2.3  Environmental  Conditions . 

A  lack  of  convective  weather  during  the  scheduled  test  period  could 
impact  the  validity  of  the  weather  performance  test  results.  Should 
favorable  test  weather  not  occur,  testing  may  have  to  be  extended  or 
moved  to  another  site. 
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FIGURE  4.1.2-1,  TDWR  BUILD  5B0T&E  FLOW 


4.2.4  Test  Analysis  and  Tools. 


The  TDWR  Special  Test  Equipment  will  be  used  to  record  and  playback 
data.  More  detailed  information  regarding  test  equipment  may  be  found 
the  TDWR  Test  Procedures. 

4.2.5  Pass/Fail  Criteria. 

Pass/Fail  criteria  for  each  test  will  be  included  in  the  TDWR  Test 
Procedures . 

4.3  OT&E  INTEGRATION  TEST  DESCRIPTIONS. 

4.3.1  TDWR--LLWAS  III  Interface  Test. 

4. 3. 1.1  Test  Objectives. 

This  test  will  verify  that  LLWAS  III  Center  Field  wind  (CFW) , 
threshold  winds,  and  Microburst/Wind  Shear  Alerts  are  accurately 
displayed  on  the  TDWR  GSDs  and  RDTs. 

The  following  TVRTM  requirements  will  be  verified  under  this  test: 

3001,  3020,  3021,  3022,  3024,  3053. 

4. 3. 1.2  Test  Approach. 

This  test  will  utilize  the  LLWAS  III  playback  function  to  play  back  a 
known  LLWAS  III  weather  scenario.  The  TDWR  GSDs  and  RDTs  will  be 
monitored  to  verify  the  LLWAS  III  data  was  properly  displayed.  This 
test  will  performed  for  both  primary  (LLWAS  III  to  RPG)  and  backup 
(LLWAS  III  to  GSD)  links. 

4.3.2  TDWR- -RMS /MPS  Interface  Test. 

4. 3. 2.1  Test  Objectives. 

The  objective  of  this  test  is  to  verify  that  the  TDWR- -MPS  and  the 
TDWR--MDT  interfaces  exist  and  are  functional.  ACN-IOOD,  with 
assistance  from  ACW-200D,  will  conduct  Build  5  OT&E  Integration  to 
verify  NAS -SS- 1000,  Volume  V  requirements  for  the  TDWR- -MPS  and 
TDWR--MDT  interfaces  after  the  baseline  Interim  Monitor  and  Control 
Software  (IMCS)  module  has  been  completed  and  tested.  The  Build  5B 
modifications  to  the  TDWR--MDT  interface  will  be  verified  during  OT&E 
Operational  testing. 

TVRTM  requirement  3054  will  be  verified  under  this  test. 
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4. 3. 2. 2  Test  Approach. 


The  system  MDT  will  be  used  to  control  and  monitor  TDWR  throughout 
Build  5B  OT&E  Integration  and  OT&E  Operational  testing.  During  OT&E 
Operational  Degraded  Operations  scenarios,  the  LLWAS--RPG  and 
LLWAS--DFU  communications  performance  parameters  will  be  verified 
using  the  system  MDT. 

4.3.3  TDWR--TCCC  Interface  Test. 

The  TDWR--TCCC  interface  was  tested  during  Build  5B  DT&E  using  a  TCCC 
simulator.  This  test  verified  that  TDWR  transmitted  graphic  and 
alphanumeric  products  to  the  TCCC  simulator.  ACN-300,  with  assistance 
from  ACW-200D,  will  perform  OT&E  Integration  when  the  TCCC  becomes 
available. 
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4.4  OT&E  OPERATIONAL  TEST  DESCRIPTIONS . 


4.4.1  System  Reliabilitv/Availabllitv  Test. 

4. 4. 1.1  Test  Objectives. 

System  operation  will  be  monitored  to  verify  that  diagnostic  accuracy, 
MTBF,  and  MTBCF  are  achievable  in  an  operational  environment.  This 
data  will  be  used  to  support  the  data  collected  during  baseline  OT&E 
Operational  testing,  as  well  as  verify  that  the  Build  5B  enhancement 
has  not  degraded  TDWR  system  reliability/availability. 

4. 4. 1.2  Test  Approach. 

During  Build  5B  OT&E  test  conduct,  all  TDWR  system  failures  will  be 
recorded  and  classified  as  critical  or  noncritical.  For  system 
reliability  tests,  the  TDWR  will  be  run  in  a  "hands-off"  mode  and  it 
will  be  verified  that  any  failures  of  interrelated  NAS  subsystems  do 
not  affect  TDWR  reliability.  Diagnostics  will  be  performed  in  event 
of  a  failure  and  all  diagnostic  results  will  be  recorded.  In  the 
event  of  critical  failure,  system  downtime  will  also  be  recorded. 

4.4.2  Degraded  Operations  Test. 

4. 4. 2.1  Test  Objectives. 

This  test  is  conducted  to  determine  the  acceptability  of  the  resultant 
operational  degradation  when  failures  are  induced  into  the  NAS  system. 
Operational  scenarios  will  be  used  to  verify  TDWR  response  to  TDWR-- 
LLWAS  III  failure  modes. 

4. 4. 2. 2  Test  Approach. 

This  test  will  verify  that  the  TDWR  responds  properly  during  the 
following  scenarios: 

a.  TDWR  and  LLWAS  III  operational, 

b.  TDWR  operational  and  LLWAS  III  nonoperational, 

c.  TDWR  nonoperational  and  LLWAS  III  operational,  and 

d.  TDWR  and  LLWAS  III  nonoperational. 

4.4.3  Stress  and  NAS  Loading  Test. 

4. 4. 3.1  Test  Objectives. 

This  test  will  demonstrate  the  TDWR  response  to  stress  and  NAS  loading 
provided  by  a  weather  scenario  test  tape  operational  environment. 
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4. 4. 3. 2  Test  Approach. 


This  test  will  stress  the  TDWR  by  utilizing  all  available  interfaces 
during  periods  of  hazardous  weather  activity.  This  test  will  involve 
playback  of  a  weather  scenario  test  tape  with  runways  mapped  to  all 
lines  of  all  RDTs.  The  LLWAS  switchover  override  option  will  also  be 
enabled  to  more  closely  simulate  a  live  operational  environment.  In 
the  event  significant  hazardous  weather  activity  occurs  during  the 
test  period,  this  test  will  be  conducted  using  a  live  operational 
environment . 

4.4.4  Human  Factors  Evaluation. 

4. 4. 4.1  Test  Objectives. 

This  test  estimates  the  degree  to  which  the  interaction  of  personnel 
with  the  system  in  the  operational  environment  is  accommodated.  OT&E 
will  explore  such  factors  as  the  physical  interaction  of  personnel 
with  the  TDWR.  In  particular,  the  following  will  be  evaluated: 

a.  The  archive  data  recording  and  playback  procedures; 

b.  The  programmable  alarm  timeouts; 

c.  The  switch  over  to  the  LLWAS- -TDWR  backup  link  procedures; 

d.  The  RDT  response  upon  failure  of  the  GSD; 

e.  The  changes  to  the  display  of  graphics  and  alphanumerics  due 
to  the  MSIA  and  TDWR- -LLWAS  III  Integration  Algorithm. 

TVRTM  requirement  3055  will  be  verified  during  this  test. 

4. 4. 4. 2  Test  Approach. 

ACW-200D  will  monitor  and  observe  tower  and  Terminal  Radar  Approach 
Control  (TRACON)  controllers  and  supervisors  while  using  the  LLWAS 
III/TDWR  data.  A  questionnaire  will  be  used  to  evaluate  Build  5B 
function  useability. 

4.4.5  Site-Adaptation  Verification. 

4. 4. 5.1  Test  Objectives. 

This  test  ensures  that  site  data  unique  to  each  applicable  NAS 
facility  has  been  correctly  developed,  updated,  and  installed  in  the 
system. 

4. 4. 5. 2  Test  Approach. 

Site  parameters  will  be  selected  at  random  and  compared  against  the 
Site  Survey  Reports.  If  necessary,  site  set-up  utilities  will  be  used 
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to  verify  these  parameters.  AOS -230  will  assist  in  the  generation  of 
detailed  test  procedures,  and  will  assist  in  test  conduct. 

4.4.6  Weather  Performance  Evaluation. 


4. 4. 6.1  Test  Objectives. 


The  objective  of  this  test  is  to  verify  the  TDWR  meets  operational 
suitability  and  reliability  requirements  in  relation  to  its  ability  to 
detect  hazardous  weather. 


The  following  TVRTM  requirements  will  be  verified  under  this  test: 


1001, 

1003, 

1004, 

1005, 

1006, 

1021, 

1022, 

1023, 

1024, 

1025, 

3010, 

3011, 

3012, 

3014, 

3015, 

3023, 

3024, 

3025, 

3044, 

3052. 

1007, 

1008, 

1009, 

1019, 

1020 

1026, 

3002, 

3003, 

3004, 

3009 

3016, 

3017, 

3018, 

3021, 

3022 

4. 4. 6. 2  Test  Approach. 


A  meteorologist  from  the  National  Severe  Storms  Laboratory  (NSSL)  will 
conduct  a  weather  performance  evaluation.  In  particular,  the 
performance  of  the  MDA  parameter  changes,  MSIA,  and  TDWR--LLWAS  III 
Integration  Algorithm  will  be  evaluated. 


4.4.7  TDWR--LLWAS  II  Verification. 


4. 4. 7.1  Test  Objectives. 

This  test  will  ensure  that  the  introduction  of  the  Build  5B 
enhancement  does  not  degrade  LLWAS  II  performance. 

4. 4. 7. 2  Test  Approach. 

The  Build  5B  enhancements  will  be  installed  at  an  LLWAS  II  site. 
Then,  it  will  be  verified  that  LLWAS  II  CFW  and  runway  mapped  sensor 
winds  are  accurately  displayed  on  the  TDWR  GSDs  and  RDTs. 
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5.  TEST  MANAGEMENT. 


5.1  ROLES  AND  RESPONSIBILITIES. 

The  following  paragraphs  shall  describe  the  various  organizations  and 
personnel  that  will  manage,  conduct,  and  support  the  testing. 

5.1.1  Test  Management  Organization. 

5. 1.1.1  Program  Manager,  ANR-50Q. 

The  Program  Manager  (PM)  is  responsible  for  management  of  the  program. 
In  particular,  the  PM  has  responsibilities  for  the  OT&E  Integration 
and  OT&E  Operational  test  effort  as  described  in  FAA  Order  1810. 4B 
Specifically,  the  PM: 

a.  Manages  the  overall  T&E  program; 

b.  Arranges  with  the  Associate  Program  Manager  for  Test  (APMT) 
for  T&E  support,  coordination,  and  monitoring; 

c.  Reviews  and  approves  OT&E  Integration  and  OT&E  Operational 
test  requirements,  plans,  procedures,  and  reports; 

d.  Monitors  OT&E  Integration  and  OT&E  Operational  Tests. 

5. 1.1. 2  Technical  Officer.  AMR-9nn. 

The  Technical  Officer  is  responsible  for  the  technical  direction  of 
the  TDWR  program.  Specific  responsibilities  include: 

a.  System  Design; 

b.  Design  Qualification  Test  and  Evaluation; 

c.  Air  Traffic  Controllers  Build  5B  Enhancement  Training; 

d.  Implementation; 

e.  Maintenance  and  Logistics  Support. 

5. 1.1. 3  APMT,  ACW-20n. 

The  APMT  is _ responsible  for  management  of  the  OT&E  Integration  and 
OT&E  Operational  test  effort.  In  particular,  the  APMT  has 
responsibilities  for  the  OT&E  Integration  and  OT&E  Operational  test 
effort  as  described  in  FAA  Order  1810. 4B.  Specifically,  the  APMT: 

a.  Supports  the  development  of  test  policy  and  test  standards; 

b.  Acts  as  an  agent  of  the  PM  to  manage  the  T&E  program.  This 
includes  establishing  test  schedules,  coordination  of  tests. 
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ensuring  that  all  test  requirements  are  satisfied,  and  that 
tests  are  performed  in  accordance  with  approved  procedures; 

c.  Coordinates  with  performing  organizations  and  monitors  OT&E 
activities ; 

d.  Prepares  OT&E  Integration  and  OT&E  Operational  test 
requirements ; 

e.  Prepares  OT&E  integration  and  OT&E  Operational  test  plans, 
procedures ,  and  reports ; 

f.  Directs  and  conducts  OT&E  Integration  and  OT&E  Operational 
tests . 

5.1.2  Other  Participating  Organizations. 


5. 1.2.1  Operation  Support  Service,  AOS -230. 

This  organization  identifies  and  develops  OT&E  Shakedown 
requirements.  In  addition,  they  are  responsible  for  conducting  OT&E 
Shakedown  testing.  They  provide  assistance  and  support  during  the 
OT&E  Integration  and  OT&E  Operational  test  effort  by  reviewing  the 
OT&E  integration  and  OT&E  Operational  Test  Plan,  Test  Procedures and 
Test  Reports.  They  also  monitor  OT&E  Integration  and  OT&E  Operational 
tests  and  optionally  participate  in  OT&E  Integration  and  OT&E 
Operational  test  conduct. 

5. 1.2. 2  Air  Traffic  Plans  and  Requirements  Service,  ATR-120. 

This  organization  provides  operational  expertise  and  planning  for 
conducting  and  analyzing  tests.  They  provide  assistance  and  support 
during  the  OT&E  Integration  and  OT&E  Operational  test  effort  by 
reviewing  the  OT&E  Integration  and  OT&E  Operational  Test  Plan  and  Test 
Procedures.  They  also  provide  personnel  for  conducting  and/or 
monitoring  OT&E  Integration  and  OT&E  Operational  tests. 

5. 1.2. 3  Regional  Airway  Facilities  Division,  AF. 

This  organization  supports  the  APMT  in  the  development  of  OT&E  test 
requirements.  In  addition,  they  provide  coordination  support  for  test 
activities . 

5. 1.2. 4  Office  of  Independent  Operational  Test  and  Evaluation 
Oversight,  ATQ-l. 

This  organization  performs  an  lOT&E  oversight  mission  which  includes: 
(1)  independent  assessment  of  system  operational  effectiveness  and 
suitability;  (2)  verification  that  systems  are  satisfactorily  tested 
and  evaluated  in  a  realistic  operational  environment;  and  (3) 
verification  that  technical  and  operational  risks  have  been 
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sufficiently  mitigated  to  warrant  production,  deployment,  or 
commissioning. 

5. 1.2. 5  Maintenance  Automation  Program  Office,  ANA -700. 

This  organization  is  responsible  for  providing  the  IMCS  and  conducting 
confidence  testing. 

5. 1.2. 6  Engineering,  Test,  and  Evaluation  Service,  ACN-100. 

This  organization  provides  assistance  and  support  during  the  OT&E 
Integration  and  OT&E  Operational  test  effort  by  preparing  and 
executing  the  RMS/MPS  test  procedures.  They  will  then  provide  ACW-200 
with  a  test  report  for  inclusion  into  the  OT&E  Integration  and  OT&E 
Operational  Test  Report. 

5. 1.2. 7  National  Severe  Storms  Laboratory,  NSSL. 

This  organization  provides  meteorological  assistance  and  support 
during  the  OT&E  Integration  and  OT&E  Operational  test  effort  by 
verifying  TDWR  base  data  and  weather  products.  They  will  then  provide 
ACW-200  with  a  test  report  for  inclusion  into  the  OT&E  Integration  and 
OT&E  Operational  Test  Report. 

5.1.3  Test  Conduct  Team. 


5. 1.3.1  Test  Director,  ACW-200. 

The  Test  Director  is  appointed  by  the  APMT.  Specifically,  the  Test 
Director: 


1. 

2. 

3. 

4. 

5. 

6. 


5. 1.3. 2 


Ensures  the  OT&E  Integration  and  OT&E  Operational  test 
effort  follows  the  specific  test  plan  and  procedures; 

Ensures  all  required  equipment  and  personnel  are  available 
prior  to  the  start  of  the  test; 

Ensures  all  relevant  data  for  analysis  is  collected; 
Maintains  a  daily  test  log; 

Conducts  pretest  and  post-test  briefings; 

Provides  the  status  of  all  testing  activities  to  the  APMT. 
Test  Manager. 


A  Test  Manager  is  not  needed  for  the  TDWR  OT&E  Integration  and  OT&E 
Operational  testing. 
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5. 1.3. 3  Test  Operators,  ACW-200,  AOS -230,  ACN-100,  AT,  AF,  MSSL. 


Test  Operators  are  responsible  for  manning  the  test  positions  during  a 
particular  test.  They  follow  the  test  procedures  and  record  all  test 
results.  In  addition,  they  will  assist  the  Test  Director  in 
maintaining  the  daily  test  log.  The  Test  Operators  report  to  the  Test 
Director. 

5. 1.3. 4  Test  Monitors.  ACW-200,  AMR-900,  AOS-230,  ATR-120. 

Test  Monitors  are  responsible  for  ensuring  that  the  test  scenarios  and 
procedures  are  being  followed  by  the  Test  Operators.  Test  Monitors 
assist  the  Test  Operators  by  reporting  observations,  assisting  in  the 
recording  of  measurements,  and  keeping  track  of  day-to-day  activities 
by  maintaining  test  logs. 

5. 1.3. 5  ATQ-l  Representative. 

ATQ  personnel  perform  the  lOT&E  oversight  mission  for  this  test  in 
accordance  with  paragraph  5. 1.2. 4  of  this  document. 

5 . 2  TRAINING . 

The  following  paragraphs  will  describe  the  training  needed  to  develop 
and  execute  the  OT&E  Integration  and  Operational  test  procedures. 

5.2.1  Test  Developer  Training. 

No  formal  TDWR  training  is  required  for  test  procedure  development  and 
execution.  However,  a  thorough  understanding  of  TDWR  system 
operation  including  the  use  of  the  System  MDT,  RPG/RMS  MDT,  BDD,  BDR, 
GSDs,  and  RDTs  is  required. 

5.2.2  Test  Participant  Training. 

Test  participants  should  also  be  familiar  with  overall  TDWR  system 
operations  including  the  MDTs,  BDR,  and  all  displays. 

5.3  TEST  CONDUCT. 

5.3.1  Quality  Control  and  Configuration  Management. 

ANR-900  will  officially  provide  software.  Version  Numbers /Checksums 
will  be  provided  before  the  start  of  testing. 

5.3.2  Test  Readiness  Criteria. 

ACW-200D  will  conduct  Build  5B  OT&E  Integration  and  OT&E  Operational 
tests  after  contractor  on-site  Design  Qualification  Tests  (DQT)  are 
completed  and  a  configuration  audit  is  performed. 
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5.4  TEST  REPORTS. 


The  following  subsections  define  the  necessary  reports  that  will  be 
generated  during  OT&E  Integration  and  OT&E  Operational  testing. 

5.4.1  Individual  Test  Results  Reporting. 

Individual  test  results  will  be  recorded  by  Test  Operators  in  the 
spaces  provided  in  each  test  procedure.  At  the  conclusion  of  each 
test,  a  summary  of  the  test  results  will  be  included  in  the  test 
procedure . 

5.4.2  Service  Reports  (SR). 

The  Test  Director  will  ensure  all  test  discrepancies  and  problems 
observed  during  testing  are  doc\imented  in  SRs.  The  SRs  will  be 
forwarded  to  the  Program  Office  for  resolution.  The  SR  format  will  be 
the  same  as  in  previous  TDWR  OT&E  testing. 

5.4.3  Periodic  Test  Status  Reports/Briefings. 

This  paragraph  identifies  the  type  of  briefings  that  will  be  conducted 
throughout  OT&E  Integration  and  OT&E  Operational  testing. 

5. 4. 3.1  Pretest  Briefings. 

This  briefing,  chaired  by  the  Test  Director,  will  be  scheduled 
immediately  prior  to  the  start  of  each  test  and  attended  by  all 
personnel  participating  in  the  test.  The  pretest  briefing  will 
include  the  status  of  prerequisites,  software,  system  equipment,  test 
equipment,  and  a  test  summary. 

The  pretest  briefing  consists  of  a  brief  explanation  of  the  type  of 
test  that  will  be  conducted,  what  the  test  will  attempt  to  accomplish, 
and  the  hardware/software  configuration  that  will  be  utilized  for  the 
test.  The  pretest  briefing  will  also  accomplish  the  following: 

a.  Identify  any  needed  changes,  and  red -line  the  procedures 
accordingly; 

b.  Review  the  hardware  and  software  configurations  of  the  test 
environment; 

c.  Ensure  that  all. items  in  the  material  check  list  (contained 
in  the  test  procedures)  have  been  received; 

d.  Provide  Service  Report  forms  to  attendees; 

e.  Generate  a  record  of  the  pretest  briefing. 


29 


5. 4. 3. 2  Post-test  Briefing. 

This  briefing  will  be  conducted  after  test  completion.  It  is  chaired 
by  the  Test  Director  and  attended  by  all  test  personnel.  The  purpose 
of  the  meeting  is  to  review  the  results  of  the  test  activity.  An 
assessment  of  the  quality  of  the  test  and  the  impact  of  the  problems 
(i.e.,  SRs)  will  be  discussed  during  the  review  of  the  Test  Director's 
post-test  briefing  package. 

The  post-test  briefing  package,  prepared  by  the  test  director  prior  to 
the  post-test  brief,  should  consist  of  the  following: 

a.  The  "as-run"  hardware  and  software  configuration,  how  it 
differed  from  that  stated  in  the  procedures,  and  its 
significance  to  the  test  results; 

b.  Any  deviations,  planned  and  unplanned,  in  the  test  procedure 
steps  and  their  significance  to  the  test  results.  Procedure 
steps  with  problems  noted  and/or  SRs  initiated  against  them 
should  be  rescheduled  for  retest; 

c.  Any  discrepancies,  anomalies,  and  exceptions  that  were 
recorded  during  the  test  and  their  significance  to  the  test 
results ; 

d.  A  summary  of  the  outcome  of  the  test.  This  summary  can  be 
derived  by  reviewing  the  test  logs,  test  data,  and  SRs  that 
were  generated. 

5. 4. 3. 3  Status  Telecons. 

These  status  telecons  will  serve  to  keep  the  TDWR  Test  Support  Group 
abreast  of  the  status  of  OT&E  Integration  and  OT&E  Operational 
testing.  These  weekly  telecons  will  be  chaired  by  ACW-200  and  will 
serve  as  a  technical  interchange  of  issues  and  concerns. 

5.4.4  Quick  Look  Report. 

A  Quick  Look  report  will  be  written  within  15  working  days  after  test 
completion.  This  report  will  include  a  description  of  the  test,  a 
summary  of  test  activities,  significant  test  results  that  are  known  at 
the  time,  and  test  result  conclusions.  It  will  provide  an  immediate 
indication  of  the  outcome  of  the  test  and  highlight  test  discrepancies 
noted  during  test  execution  and  their  significance. 

The  Quick  Look  Test  Report  will  contain  the  following: 


a.  Quick  Look  Test  Report  title  page; 

b.  Executive  Summary; 

c.  Introduction; 
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d.  OT&E  Description; 

e.  Results; 

f.  Conclus ions /Recommendations . 

5.4.5  Final  Report. 

The  TDWR  Test  Director  will  be  responsible  for  preparing  a  Final  Test 
report  within  60  days  after  all  OT&E  testing  is  complete.  The  Final 
Test  Report  will  document  the  results  of  detailed  test  analysis,  and 
assess  the  compliance  of  each  test  to  defined  criteria.  The  status  of 
problems  identified  previously  in  the  Quick  Look  Test  Reports  will  be 
updated,  and  a  revised  assessment  will  be  made  of  their  impact  on  the 
tested  system,  and  the  suggested  corrective  actions  required.  Any  new 
problems  discovered  by  detailed  evaluation  will  be  identified  and 
their  impact  in  the  system  described. 

The  Final  Test  Report  will  contain  the  following: 

a.  Final  Test  Report  title  page; 

b.  Executive  Summary; 

c.  Table  of  Contents; 

d.  Introduction; 

e.  Documents  referenced; 

f.  System  Description; 

g.  Test  Description; 

h.  Results  and  Discussion; 

i .  Conclusions ; 

j.  Recommendations; 

k.  Acronyms  and  Abbreviations. 

5.5  SCHEDULES  AND  PERSONNEL  REQUIREMENTS. 

This  section  includes  the  overall  schedule  of  TDWR  Build  5B  OT&E 
events  and  personnel  requirements  for  OT&E  Integration  and  OT&E 
Operational  testing. 
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5.5.1  Test  Schedule. 


This  section  presents  the  schedules  for  TDWR  OT&E  Integration  and  OT&E 
Operational  activities.  TDWR  OT&E  activities  are  traceable  and 
supportive  of  the  TDWR  TEMP. 

This  schedule  indicates  the  TDWR  OT&E  Test  Activity  as  shown  in 
appendix  B.  The  schedule  is  developed,  released,  and  controlled  by 
the  Test  Director,  ACW-200.  The  function  of  this  schedule  is  to 
provide  guidance  for  all  TDWR  activities.  They  identify  the  major 
tasks  to  be  accomplished  (e.g..  Test  Plan  and  Test  Procedures 
complete)  and  identify  task  start  and  stop  dates.  This  schedule 
enables  the  Test  Director  to  provide  detailed  test  status  to  the  test 
groups . 

5.5.2  Personnel  Resource  Requirements. 

The  personnel  requirements  for  OT&E  Integration  and  OT&E  Operational 
test  conduct  are  included  in  table  5. 5. 2-1. 
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TABLE  5. 5. 2-1  TDWR  OT&E  INTEGRATION  and  OT&E  OPERATIONAL 

TEST  SUPPORT  PERSONNEL 


ORGANIZATION 

ACW-200D 

ACW-200D 

AF  Field  Personnel 

AOS-230 

ATR-120 

ACN-100 

ATQ-1 

NSSL 

ANR-900 


NO.  OF  PEOPLE 
1 

1/1 

1-2 

1-2 


1 

2 

1 

1 

1 


POSITION 

Test  Director 

Test  Monitor /Opera tor 

Test  Operator 

Test  Monitor/Operator 

Test  Monitor/Operator 

Test  Operator 

Test  Witness 

Test  Monitor 

Test  Witness 


Note:  Not  all  of  these  organizations  will  be  present  during  every 
test.  The  test  procedures  will  identify  appropriate  personnel. 
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6.  ACRONYMS  AMD  ABBREVIATIONS. 

A  Analysis 

ACN  Engineering,  Test,  and  Evaluation  Service,  FAA  Technical 

Center 

ACW  Weather  and  Primary  Radar  Division,  FAA  Technical  Center 

ADR  Archive  Data  Recorder 

AF  Airways  Facilities 

ANR  Program  Director  for  Weather  Radar 

ANT  Antenna 

APMT  Associate  Program  Manager  For  Test 

AOS  Systems  Maintenance  Seirvice,  FAA  Aeronautical  Center 

AT  Air  Traffic 

ATC  Air  Traffic  Control 

ATR  Air  Traffic  Plans  and  Requirements  Service 

ATQ  Office  of  Independent  Operational  Test  and  Evaluation 

Oversight 

BDD  Base  Data  Display 

BDR  Base  Data  Recorder 

bps  Bits  per  second 

CFW  Center  Field  wind 

CMTP  Contractor's  Master  Test  Plan 

CMU  Concrete  Masonry  Unit 

COTS  Commercial-Off-the-shelf 

CSCI  Computer  Software  Configuration  Item 

D  Demonstration 

DFU  Display  Functional  Unit 

DPL  Display  Computer  Software 

DPO  Data  Processing  Operating  System 

DQT  Design  Qualification  Test 

DSP  Digital  Signal  Processor 

DT&E  Development  Test  and  Evaluation 

DVX  Terminal  Doppler  Weather  Radar  site  in  Denver,  CO 

FAA  Federal  Aviation  Administration 

FAAAC  Federal  Aviation  Administration  Aeronautical  Center 

FAR  False  Alarm  Ratio 

GSD  Geographical  Situation  Display 

HWCI  Hardware  Configuration  Item 

I  Inspection 

ICD  Interface  Control  Document 

IMCS  Interim  Monitor  and  Control  Software 

IRD  Interface  Requirements  Document 

LLWAS  Low  Level  Wind  Shear  Alert  System 
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MBA 

MDA 

MDT 

M&OS 

MPS 

MS  I A 

MTBF 

MTBCF 

MTS 

NAS 

NSSL 

OS 

OT&E 

PM 

POD 

PSF 

RDA 

RDT 

REX 

RMMS 

RMS 

RPG 

SON 

SCU 

SDT 

SFO 

SPB 

SPT 

SR 

T 

TCCC 

TDWR 

T&E 

TE 

TEMP 

TRACON 

TTL 

TVRTM 

UNIX_UNX 

VRTM 

VTX 

WSA 


Microburst  Alerts 
Microburst  Detection  Algorithm 
Maintenance  Data  Terminal 
Maintenance  and  Operations  Support 
Maintenance  Processor  Subsystem 
Microburst  Shear  Integration  Algorithm 
Mean  Time  Between  Failure 
Mean  Time  Between  Critical  Failure 
Moving  Target  Simulator 

National  Airspace  System 
National  Severe  Storms  Laboratory 

Operating  System 

Operational  Test  and  Evaluation 

Program  Manager 
Probability  of  Detection 
Program  Support  Facility 

Radar  Data  Acquisition 
Ribbon  Display  Terminal 
Receiver /Exciter 

Remote  Maintenance  Monitoring  System 
Remote  Monitoring  Subsystem 
Radar  Product  Generator 

Specification  Change  Notice 
Servo  Control  Unit 
Software  Development  Tools 
Sector  Field  Office 
Site  Program  Bulletin 
Special  Test  Equipment 
Service  Report 

Test 

Tower  Control  Computer  Complex 

Terminal  Doppler  Weather  Radar 

Test  and  Evaluation 

Transmission  Equipment 

Test  and  Evaluation  Master  Plan 

Terminal  Radar  Approach  Control  Facility 

Test  Tools  Library 

Test  Verification  Requirements  Traceability  Matrix 

Display  System  Operating  System 

Verification  Requirements  Traceability  Matrix 
VRTX-32  Operating  System 

Wind  Shear  Alert 
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Not  Applicable 
Transmitter 


APPENDIX  A 

Test  Verification  Requirements  Traceability  Matrix 


Terminal  Doppler  Weather  Radar 

NAS -SS- 1000  Volume  I  Test  Verification  Requirements  Traceability  Matrix 


Terminal  Doppler  Weather  Radar 

NAS -SS- 1000  Volume  I  Test  Verification  Requirements  Traceability  Matrix 
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Build  5B 
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Terminal  Doppler  Weather  Radar 

NAS -SS- 1000  Volume  V  Test  Verification  Requirements  Traceability  Matrix 
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